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Abstract 

This paper considers student use of a web-based discussion forum in a second year, non-major Biology 
course. The authors discuss how meaningful participation in the forum is a form of public writing and may be an 
indicator of overall student success in the course. The authors also discuss how this success in the course is not tied 
to the students’ previous performance at the post-secondary level. 

Introduction 

Over the past decade, the researchers have been investigating the effects of student participation in 
electronic messaging. This investigation has evolved as both the technology has changed and the research trends in 
the field have adjusted to reflect both these new technologies and current theories behind learning in technology 
enhanced environments. As the focus of this investigation has evolved, it has shifted on the question of whether 
students’ participation in a class web-based discussion forum has an effect on their final course grade. 

This article reviews the evolution of this study and explores the research question based upon the nature of 
the participation and the individual abilities of the student. 

Literature Review 

Berge and Collins (1993) indicated that the main benefits of web-based discussion forums were the 
convenience for students, the time and place independence that it created for students, and the potential for students 
to become part of an online learning community. In addition to these primary benefits, there has also been 
considerable research into whether or not students participation in asynchronous means of communication, such as 
electronic mail and web-based discussion forums, have an affect on students’ performance. 

In 1989, Slovacek reported that "there appeared to [be] a positive correlation between students' use of e- 
rnail to augment normal in-class communication with their instructors and final course grades [specifically] that each 
e-mail message initiated by the students was associated with a 1.781 point increase in final course grade on average” 
(pp. 113-114). However, Collins (2000a) reported little difference between the final course scores of e-mail users 
and non-users. It was reported in that same study that a positive relationship existed between the level of Web forum 
use and final course scores . 

This distinction may be explained by Piirto (1998), who reported that approximately half of the students 
surveyed responded "never” or "not often," when asked if they proofread and/or edited their electronic mail. This 
was compared to 90% of students who responded that they proofread and /or edited their written documents "every 
time" or "most of the time.” (p. 28) According to Piirto, the level of care that university students place into their 
composing of an electronic mail message was very low. This was supported by Collins and Barbour (2001a), which 
speculated that while e-mail messages are often short messages about non-content queries which are “private” and 
only for the instructor's eyes, postings to the Web forum are “public” and open to the scrutiny of all class members. 
Students are more likely to be careful and deliberate about what they write on the web forum because they are for 
public consumption (p. 8). 

The careful and deliberate writing by students having an effect on student performance is supported by 
Ambron (1987), who reported “student response [was] extremely favourable; ... most mentioned the value of 
writing in helping them understand [the subject.]” (p. 266). Moore (1993) reported that “learning improves ... when 
writing assignments are complemented with instruction about how to use writing as a tool to learn [a subject.]” (p. 
217). In addition, Chickering and Gamson (1987) reported that one of the seven principles for good undergraduate 
education was that students “must talk about what they are learning [and] write about it” (p. 5). They also detailed 
that interaction between students and the professor and between students and other students is a key mechanism in 
enhancing learning. This is further supported by Moore (1994), who reports that people learn as they write, ideas 
form as pen hits paper and that writing about a subject is a way of knowing the subject because writing creates 
meaning. 
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This line of inquiry is supported by the research into microthemes. “Microthemes are a special kind of 
student writing whose length is strictly limited, usually to 150-400 words.” These written assignments have been 
used in many larger undergraduate classes in the hard sciences. “Microthemes are marked for their ideas rather than 
their grammar and spelling” (Collins, 2004, p. 7). Over a four year period, Collins (2000) found that there was an 
overall mean gain of 0.67% in student scores between those students who completed microthemes and those 
students who completed a term paper. In addition, the average test scores of students who completed 9-11 
microthemes was 13.2% than the average test scores of students who completed only 1-6 microthemes. 

The Study 

The courses considered in this study are Biology 2040 - Modern Biology and Human Society I (Human 
Biology) and Biology 2041 - Modern Biology and Human Society II (Environmental Science), large enrolment 
second-year, non-major Biology courses which were regularly offered in on-campus lecture, off-campus 
correspondence and Web-based formats. During the period 1994-2001 , student contributions to a discussion forum 
and e-mail messages sent to the instructor were collected. 

This study initially began as a professor “searching for a way to improve student-student and student- 
professor interaction in a large second year biology course . . . [that had] increased from 40, when [he] first taught it, 
to over 170 students in the 1995 winter semested' (Collins, 1995a, p. 1). The first system that was utilized for this 
project was a text -based environment, “DEC Notes would allow students to post and reply to notices, or to just read 
notes and their responses, although they could still contact [the professor]” (Collins, 1997, p. 189). Research into 
this system was focused upon how the students used the bulletin board, considering rnanyof the variables raised by 
Berge and Collins (1993). For example, Collins (1995b) stated that one of the perceived benefits of the system was 
“its availability around-the-clock so that students can ask questions, make comments, etc. at any time that suits them 
rather than having to wait for class or an opportunity to talk to the professor” (p. 189). Collins (1998) reported that 
“two thirds of the student use was for on-going discussions of a variety of topics such as the ethics of genetic 
engineering, the right to die, AIDS and youth, and the Red Cross and blood donations” (p. 80). 

This level of analysis was eventually expanded to include comparisons between different methods of 
delivery (i.e., correspondence, web-based and on-campus lecture) of the same course by the same professor. Collins 
(2000a) reported “that the correspondence section achieved the higher mean final scores in three of the four 
semesters while the Web course achieved the higher mean score in only one semester” (pp. 22-23). Additionally, 
Collins and Barbour (2001a) reported that “the results of an analysis of final course scores indicate that students in 
the Web-based sections generally perform at a lower level than those in the traditional classroom format, and these 
in turn perform at a lower level than students in the correspondence sections” (p. 310). At the time, these findings 
were in marked contrast to other similar studies (Navarro and Shoemaker 1999; Wideman and Owston 1999) which 
found that students in Web-based courses did better than those in both on -campus and correspondence courses. For 
example, Wideman and Owston (1999) reported that "on the whole students in Internet and in-class courses scored 
significantly higher than their counterparts in correspondence courses, although no significant difference was found 
between Internet and in-class students" (p. 2). 

Collins (2000b) marked the next phase of this study, when the authors began to consider the effect of 
participation in the Web forum upon a students’ performance in the course. “There [did] not appear to be a 
relationship between e-mail use and final course score” (p. 7). However, there appeared to be a positive relationship 
between Web forum use and final course score. Collins and Barbour (2001b) reported 

only ‘A’s were very frequent users, and only ‘A’s and 'B’s were frequent users. Only about one-third 
of ‘C’s, 'D’s and ‘F’s were infrequent users while two-thirds made no use of the Web forum. Students 
achieving an ‘A’ in the course were much more likely to be Web forum users (21 of 42) than 'B's (12 
of 29), who, in turn were more likely to be users than ‘C’s, ‘D’s, and ‘F’s (only 7 of 20). (p. 7) 

This relationship was further explored in Barbour and Collins (2002a, 2002b, & 2003a). 

However, this exploration led to the question of whether “higher levels of motivation or scholastic 
achievement may also lead some students to participate in electronic messaging more than others” (Althaus, 1996, p. 
14). It also presented another “question of whether it is the act of writing which accounts for this enhanced learning 
or whether that interaction be meaningfully based upon the content area” (Barbour & Collins, in press). 

Data and Findings 

As it was mentioned above, earlier studies have indicated a relationship between frequency of use of the 
web forum and final letter grade, as is summarized in Table 1. 
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Table 1 - Frequency of use of the web forum and final letter grade from 1997 academic year 





Course grade 


Level of use 


A 


B 


C 


D 


F 


Very frequent 


2 


0 


0 


0 


0 


Frequ\ent 


1 


2 


0 


0 


0 


Infrequent 


18 


10 


4 


1 


2 


None 


21 


17 


7 


2 


4 


Totals 


42 


29 


11 


3 


6 



However, this still does not address the question of whether it is interaction or the act of writing which 
accounts for this enhanced learning or should that interaction be meaningful based upon the content area. In order to 
answer the above question each student message was assigned a value based on the following scale. 

0 - No content basis 

1 - Administrative 

2- Content -based question or message 
3 - Content -based question or message with brief explanation 
4- Content-based question or message with substantial, but incomplete explanation 
5 - Content-based question or message with complete or near complete explanation. 

For this analysis, it was determined that the Spring 1999 semester of Biology 2040 was the only class that had 
enough messages to provide an adequate sample for this scale to be utilized effectively. 

While, the vast majority of messages that were posted to the web forum were rated in the lower three 
categories, with approximately 55% of the posts being assigned a rating of 0 or 1, there were five posts assigned a 
rating of 4 or 5. The majority of the messages analyzed were of an administrative nature, such as questions about the 
timing or format of assignments or exams, however, 46% of the messages did have some content-basis (i.e., were 
rated 2 or higher). When the scale value for each message is averaged on a student by student basis (e.g.. Student 1 1 
posted eight messages which were rated 2/4/2/2/1/1/3/1 would fall in the 1.51-2.00 range as the average value of 
these messages is 2), the following table is produced. 



Table 2 - Value of use of the web forum and final letter grade 





Course grade 


Value of use 


A 


B 


C 


D 


F 


2.01-2.5 


1 


0 


0 


0 


0 


1.51-2.0 


3 


2 


1 


0 


0 


1.01-1.5 


1 


0 


1 


1 


0 


0.51-1.0 


2 


1 


2 


0 


0 


0-0.5 


0 


0 


0 


0 


0 


Didn’t use web forum 


1 


3 


0 


0 


3 


Totals 


8 


6 


4 


1 


3 



This table indicates a similar pattern to the one found earlier by Barbour and Collins (2003b). The only 
student who had an average message value of higher than 2.0 scored an “A” in the course. The majority (5 out of 6) 
students who had average message values of 1.51 to 2.0 scored an “A” or a “B”. The only students who scored an 
“F” in the course did not use the web forum at all. 

The next data set addresses the issue raised by Althaus (1996), whether students do well because they 
participate more in the Web forum or whether stronger students are simply the ones who participant the most in the 
Web forum. The table below provides the difference between the student’s overall average at the university and the 
student’s average in the course based upon their level of participation in the Web forum. 



Table 3 - Students mean adjusted score based upon level of web forum usage 



Level of web forum usage 


Number of students 


Mean Adjusted Score 


None 


8 


-1.99 


Low 


7 


+0.10 


Medium 


4 


+8.25 
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High 



5 



+15.40 



As is indicated in the table, the eight students who did not use the Web forum at all had an average in 
Biology 2040 that was 1.99 percent less than their overall university average. However, the five students who were 
high users of the Web forum had an average in Biology 2040 that was 15.40 percent higher than their overall 
university average. 

Barbour and Collins (2003b) “indicated that there existed a positive, but not conclusive, relationship 
between the number of times students posted to the Web forum and the grade that the student received. This study 
has found similar results, not solely based upon simply interaction, but on meaningful, content-based interaction.” 
The data presented above illustrates that in addition to there being a positive relationship between students’ 
meaningful content-based participation in a Web forum and their final course grade, the relationship does not appear 
to be dependent upon the students’ higher levels of motivation or scholastic achievement. This analysis is also 
supported by the findings of Wu and Hiltz (2003). Wu and Hiltz found that “students felt that they learned a great 
deal from their peers through online discussion. . . [and that] online discussion increased their learning quality” (p. 
691). 



Conclusion 

Initial studies into the relationship between students ’ participation in electronic messaging and students’ 
final course grades indicated that there was a positive relationship between students participation in the Web forum 
and their final course grade, but no relationship between the use of e-mail and their final course grade. Later studies 
found that it wasn’t simply participation in the Web forum, but meaningful content-based participation that also 
showed a positive relationship to students’ final course grades. Based upon these findings, the researchers 
speculated the public act of writing in a web-based discussion forum had a positive affect on student performance. 

The data presented in this article indicates that in addition to these earlier findings, the researchers 
speculation appears to be correct, in that students do well because they participate more in the Web forum, as 
opposed to the notion that stronger students are simply the ones who participant the most in the Web forum. 
However, it should be noted that from five years, representing dozens of classes, there was only one class in which 
there was enough student participation in the Web forum to conduct this analysis. In addition, this one class only 
represented twenty-four different students (compared to the over one thousand students who have taken Biology 
2040 or 2041 during the period studied by the researchers. 
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